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1. IntTodaction 



"In 1988, it was reported in the United States that there was a problem with economic 
literacy of the American high school Students (Walstad and Soper, 1988). We do not 
know if the same is true for the German-speaking countries. The reaso^^ is not that high 
school students in these countries possess a high standaid of economic literacy, but 
rather that the state of economic knowledge among students has never been assessed 
To correct this situation, we decided to translate the Test of EoMionuc Literacy (TEL) 
(Soper and Walstad, 1987) and to administer this German version to students in our 
countries." 

With these words we began our first paper presentation on this problem at the AERA 
meeting 1989 in San Francisco. In the "first phase" we wanted to examine whether the 
TEL is suitable as a test fcM- asKssing the economic literacy of German-speaking 
students. In short we firstly reported the translation problems, secondly the results of a 
questioning of German, Austrian and Swiss University professors as to the content vali- 
dity of the German version of the TEL, which we call WBT ("Winschaftskundlicher 
Bildung-Test") and, thirdly, the outcomes of a first application of the WBT witl) some 
750 students. 

Here it is enough to say that the results of this pilot study motivated us to continue this 
work. On the basis of an itemanalysis we improved some items with extreme values on 
difficulty or discrimination scores. We are now applying the revised version on larger 
samples of Austrian an German students in different levels and branches of our school 
systems. 

Besides assessing the WBT-scorc we gather data on attitudes to economics, on intelli- 
gence, and on moral maturity. We think that these concepts are components of "econo- 
mic education" in the wider sense of this notion. 

Today we would like to present and discuss some results of our investigations concer- 
ning the WBT. One of our main interest points is the comparison between the US and 
our countries with regard to the achievement level of the 11^ and the 12^*^ graders. Un- 
fortunately, to date we have •»ot enough data from the German students because of not 
forseen difficulties with the school boards concerning their readiness to allow the 
collection of data. But today the school doors arc open. Yet the time was too short to 
have all data collected and computed for this meeting. We are now able to present the 
results from a sufficiently large sample of Austrian students and we have also the 



infonnation about their teachers' judgements of the WBT-items which is important for 
the evaluation of its content validity. 

Before showing the results of the different tested groups we have tested it is necessary 
to analyze the conditions for the comparison, i.e. the curricular prerequisites under 
which the data are to interprcte. Then we want to draw your attention on the q)inions of 
the teachers about the WBT. We can learn from that whether the measure one obtains 
from administering the WBT is something which - in the eyes of this important group of 
experts - relies on a relevant basis of content. Our last point is the presentation of the re- 
sults we got in testing four different groups of Austrian students and the comparison 
with their US-American peers whose measures were published by Sopcr and Walstad in 
1987. 

2. Economic Education in the USA. Germany and Austria 

Comparisons of school achievement always beg to question whether the instrument of 
measurement is equally appropriate for students from several (school) cultures. The 
problem of comparing student samples and therefme of 'test fairness' must be discussed 
on the outset. Only when this is explained the comparative data can be meaningfully 
interpreted. 

2. 1 . School systemrclated differences 

A comparative analysis of the central features of Economic Education provide a first 
answer as to the fairness of the test. We have attempted this on two levels so far: 

1. Comparison of the school systems 

2. Comparison of the curricula. 

Let us start with the school systems. We have tried to depict the most important features 
of the three school systems for a comparison. Tables la, b, and c show the different 
structures. 

For those who are familiar with the American system it is sufficient to remark only one 
point of Table la for the comparison: Students in classes 1 1 and 12 attend without 
major exceptions cnfi school type, the Senior High School. Within this school the 



students have usually the choice between many optional subjects, one of which is 
economics. 

The Geiman and Austrian school system is considerably different in this respect 
Students in grades 11 and 12/' 3 attend many types of schools in Austria and Germany. 
Only the Elementary Schools (grades 1-4) are comprehensive schools in both countries. 

German and Austrian students at the age of 10 and then again at the age of 14 (Austria) 
or 15 (Germany) have to choose which of the school types listed on Table 2 they want 
to attend. They are not allowed to decide whether ca- not they will be tought a lot of 
economics at these schools. The course-content is mandatory (with only very few 
exceptions). 

These differences in the systems of the USA on the one hand and of Austria and Ger- 
many on the other "distort" the conqjarison of the Economic Literacy of the students. 
The American students have the possibility of choosing 'economics' among many other 
courses at their coiriprehensive school. The German and Austrian students must choose 
between types of schools and this (tecision is probably in no way influenced by their 
interest in economics. They are looking at the legitimations they can get at any school 
and at the role it can play in career planning but they normally don't look at the content 
and the objectives of the curricula. 

For the comparison with US-data we have drawn the major pan of our sample from the 
group of the 17 years old students who were in the last but one or in the last year of 
their school. (The only major exception is school type No. 4 (Germany); the reasons for 
the inclusion of that group are not to discuss here for we'll not present data for it.) 

It may be of interest to know the approximate percentage of an age-group attending the 
different schooltypes. The figures we show on Table 3 are somewhat rough estimators - 
it is very difficult to get valide informations - but they show the quantitative importance 
especially for the vocational schools. 

This may be enough for a first glance at the institutional conditions under which the 
comparison has to be done. It is hard to say which of the Austrian/German groups is the 
most similar to the American high school students. May be this is mostly true of our 
No. 1 - students (at least looking at the formal strucmre of the education; cf. Table 3) 
but one must have in mind that our No. 1 - students are, so to say, of the best quality, 
the brightest ones. With respect to the general level of intellectual competencies the 
students in the school types No. 3 and 5 would - roughly spoken - be more similar to 
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American highschool students. But the difference is that they have already made a 
complete decision of vocational specialization. We will reach a better answer to this 
question when we look at the time tables and the curricula of our young poeple. 

2.2. Time Budget-related differences 

In American schools where students usually choose economics in the 11 ^ or 

12th 

classes it cannot be easily grasped which additional economic knowledge related sub- 
jects they have chosen. You do only know the core of subjects. As far as we know it 
may occur that students with or without an econcHnics course can also choo% a course 
in consumer economics. But there are other possibilities for learning rcotiomic con- 
cepts, e.g. in social studies courses like government/world studies or geography, and so 
on. 

This is nearly the same in Austria. But there arc also major differences as one can sec 
looking at Table 4a. It provides information about the number of hours per week for 
subjects with more or less but mostly less relationships to economics according to type 
of school, subject, and grade. Note: We have normally 40 weeks of instruction per year 
and the curricula arc always valid for one whole year. Like in the U.S. there arc also 
several subjects with affinity to ^onomics, starting horn "History and Social Studies" 
(No. 1) through "Accounting and Economic Mathematics" (No. 5) to "Economics" itself 
(No. 7). Similar circumstances are to be found in (3eraiany as one can see on the Table 
4b. 

The major difference between the U.S. and our countries mentioned above is: Whatever 
type of school an Austrian or German student has attended, he/she was confronted with 
economic topics. The major difference between the Austrian and German school type 
is: From the 8^*^ grade on, teaching in economic-knowledge related subjects differs 
greatly and these differences should appear in the test results. 

Looking only at the amount of hours per week we would expect that students of school 
type No. 2 (Senior Voc. Schools) in both countries perform best on the WBT. In Austria 
students of school type No. 3, 5, and 1 follow on the next ranks. In Germany we should 
find the ranking order put down at the bottom of Table 4b. 



2.3. Curriculum-related difTerences 



Tables 4a and 4b do not give an answer to the question to what extent Austrian and 
Gennan students are substantially confronted with economics and, in particular, with 
the conception of 'economics' that forms the basis of the TEL. The answer to this 
question is to be found in a comparison of the 22 concepts in the MCXj with the 
concepts of the syllabus plans of the German and Austrian schools. 

Again we have provided a table for this comparison. On Table S we have listed the 22 
concepts used for the construction of the TEL/WBT. You find for each school type in 
Austria and in Germany whether a ccMicept is tieated or not. Brackets mean that a con- 
cept is not explicitly contained in the syllabus but is mentioned indirectly or in 
additional remarks to the syllabus. Lock at the following example: If the aim in the 
German syllabus text runs as follows: "Survey of fusion of firms and competition-policy 
regulations of processes of concentration in a social market economy", we assigned this 
to concept No. 5 "Economic Institutions and Incentives" but put it in brackets. 

The analyses for Austria shows (cf. Table 5): 

1. All Austrian students receive economic lessons at school which should be just as 
demanding with regard to the aims as lessons on the basis of MCG. 

2. Until the 8*^ grade - please look at the column "HS" meaning "lower secondary 
school" - these lessons are nearly identical for all students and comprise in total 
about three hours per week over 3 years in a subject called "Geography & Econo- 
mics". 

3. From the 8^^ school year on all students besides those in vocational schools re- 
ceive economic lessons although in differing class-years with qualitative and 
quantitative differences. All the concepts of economics are only to be found in 
two subjects, namely "Geography & Economics" (No. 3 on Table 4a) and "Econo- 
mics" (No. 8 on Table 4a). All other subjects are business and business-related 
courses. 

4. Table 5 shows that, directly or indircctiy, roughly the same concepts are to be 
found in the Austrian economics curricula as in the MCG. 

5. The Austrian syllabus plans do not allow, as in MCG, the setting of the cognitive 
level at which the concepts should be taught. The formulation of the aims, how- 
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ever, shows that, when they leave schooU Austrian students should have that 
knowledge, problem awareness, and faculty of judgement that the MCX3 demands 
from American high school students 'with economies'. 

6. The German version of the TEL, the WBT, therefwc proofs itself as a test which 
is principally appropriate for the aims of Austrian teaching of economics. It is not 
unfair to u% it to test Austrian students. 

The analysis of Table 5 for Germany shows quite different facts: 

1. Until the 8^ grade there is no instruction in economics nor in economics-related 
subjects. 

2. There is only one group, namely school type 2 ("SVS"), who receives lessons on 
economics-related objectives nearly to the same extend as the MCXJ would de- 
mand. 

3. There is one agreement between Austria and Germany with regard to the 
curriculum question: The concepts of economics are only presented in two 
subjects, i.e. "Economics" and "Social Studies". 

4. The German (here: the Bavarian) syllabi allow the settir ,? of the aims on a co- 
gnitive taxonomy which is slightly different ftom that in the MCG. Accounting 
for this differentiation one can calculate a probability score for a conect answer 
on every item in the WBT. We don't show the procedure for that now. The result 
is that the average probabilities per item for Form A are falling from .82 (School 
type 2 "SVS") to .49 (School type 1 "GSS"). 

5. The question whether the WBT is fair or not can only be answered with a hint to 
the norms well have to calculate. They must differ with respect to the different 
curricula. 

If you arc now looking at the bottom of Table 5 you'll remark in the second line from 
bottom the numbers of occurrences of matchings between the TEL/MCG-concepts and 
the syllabus plans of our different schools. Again, we can rank the school types with re- 
gard to our expectations we should have for the perfcMmance on the WBT: The lower 
the number of matchings, i.e. the lower the number of concepts taught within school 
type, the lower the chance of the students to reach high scores. 
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Looking back at Tables 4a and 4b you see that there is sonie change in the ranks for 
Austria and Germany. We can learn from this that a comparison only based on the time 
spent for econtmiic-related instructions is only one possibility to rank the different 
groups. We will see later on which of our hypotheses on the performance ranks will fit 
with the data. 

3. Teacher's Judgements on the WBT (TEL) 

If our analyses of syllabus plans are valid and if tethers give heed to their syllabus 
plans then we shouu'l expect the teachers to judge the WBT as a valid instrument. Is this 
the case? We asked the teachers of our students to answer the following questions 
(where we omitted the teachers of school type No. 1 because we couldn't guarantee that 
they have any knowledge of economics): 

"Please look at the 46 items of the WBT and tell us whether - in your opinion - 
they are rather good or rather poor indicators for "Economic Literacy". You may 
express your judgement on a scale running from 1 (very good indicators) to 5 
(very poor indicators)." 

To cxaminu whether beneath the criterion "Economic Literacy" other concepts with si- 
milarity in meaning fit better on the concept leprcscnted by the WBT we presented 
different groups of teachers also the terms "Basic Economic Education" (wirtschaftlichc 
Gnindbildung), "Basic Economic Knowledge" (winschaftliches Grundwissen), and 
"Knowledge about Economy" (Winschaftskenntnisse). 

Moreover we wanted to know whether teachers from different school types differ in the 
tendency of judgement Neither school type nor the different concepts produced signifi- 
cant relations within the ratings. Table 6 therefore shows only the overall means for 
each item. 

As one can see the values are quite good (with an average of 2.0 for form A and 
2. 1 for form B) and the standard deviations are not high. There are only three items 
which fall on the negative side of the scale: No. 2A, a question on opportunity cost - no 
wonder that it appears here for this concept is not treated in Austria as you may 
remember from Table 5; the same is true for item No. 2B; and the third item is a 
question on the concept of "productivity", namely a question on dimmishing returns. 
For the latter we have at the moment no idea why it is rated not so good. (In the WBT it 
is nearly a word by word translation from the TEL.) 



All in all the teachers judge the items of the WBT as "good" indicators for "Economic 
Literacy". Their ratings are in the average a little better than those of the university pro- 
fessors we asked in our pilot study (form A: mean 3.15, std. dev. .70; fc»m B: mean 3.3, 
std. dev. .77; cf. Beck/Krumm 1989, 1 1). Supposing that teachers' ratings are hkmc 
cuiriculum oriented (or curriculum affected) whereas professors' ratings are more 
related to the "structure of the discipline" we can look at both votes as rather strong ar- 
guments for the content validity of the WBT. 

To sum up: The teachers' ratings support the results of our curriculum analyses that it 
makes sense to use the WBT as a measure for Economic Literacy in our countries. Let 
us now look at the results of our Austrian data. 

4. Hmpirical Results and Comparisons 
4.1. Fomial Aspects 

We start with a glance at some of the most important statistics. They are summed up in 
Table 7. Though the figures indicate that form A and form B of the WBT are roughly 
equivalent we have to state that the values for Crombach's alpha, i.e. the internal con- 
sistency, and for the average item-total-correlation, i.e. the average discrimination 
coefficient, are not as good as in the American version. Admittedly, the alpha- 
coefficients s»'^m to be just acceptable but we view the relatively low amount of the 
average discrimination coefficients with concern. 

On Tables 8a and 8b, left side, the single scores for every item are listed. Sonw are very 
low and there are only few scores of sufficient amount Hie correlation between the 
TEL and the WBT discrimination coefficients is only .56 for form A and .38 for form 
B. The reason for this problem may stem from the heterogeneity of the Austrian 
students with regard to the reality of instruction they are confronted with. That is: The 
22 concepts could be treated in the different school types with very different weights 
with the consequence that an individual item is not a good predictor for the correctness 
of answers on the other items. 

On the other hand the standard (tevialions of the nwans of the WBT arc somewhat lower 
than those of the TEL (cf. Table 7) - a fact which can be seen as an indicator of a 
greater homogeneity of the Austrian sample. The standard errors of measurement of the 
TEL and the WBT are nearly the same. This is because the lower reliability coefficient 



of WBT is compensated by the lower standard dfiviation. As a last point of this 
comparison look at the means of the TEL and the WBT. The differences between Form 
A and B go in the same direction but, again, the value for the WBT- version is with 1.69 
not as low as it would be (tesirable. 

Now, looking at the ccmstruct validity we can state that the ii»ans of the diflexent 
groups of students develop in the expected direction. On Table 9a you find on the three 
right columns the ranks estimated and the ranks drawn from the data. For fomi A there 
is one mutual change between school types No. 1 and 3 where we estimated fiom the 
analyses of syllabus plans that school type No. 1, the General Secondary School, should 
range after the Intermediate Vocational School on place No. 3. For form B we found a 
perfect match of hypothesis and data. 

Please remember that we pointed out eariier that the MCXj-matches should be the better 
predictors for the ranks than the hours of instruction. Table 9a shows that this is true on 
the basis of our data. But again, keep in mind, that making hypotheses on this basis is 
not yet as precise as one has to wish. It would be better if it were possible to extend the 
concept of match-counting on a second dimension: the cognitive levels of objectives 
and the test-items. It is true that between both lies the reality of teaching and learning. 
We don't know whether the teachers do precisely what the syllabus plans prescribe. But 
the more books and other learning aids are developed on the basis of syllabus plans the 
closer the connection between aims ^d item-responses should be. We are planning 
therefore an analysis of the most important books, too. 

Coming back to the construct validity we can look back at Tables 8a and 8b for a re- 
view of the performance on each item for the four groups of students. We murt confess 
that beyond the aggregate data the picture is not as clear as it could be. On form A we 
have only 12 items with the expected rank order and on fonn B even only 10. The major 
exchapf ;s of ranks occur between school types No. 3 end No. 1 where - opposite to the 
hypothesis - No. 1 shows in 26 cases (form A) and in 24 cases (form B) a higher per- 
centage of correct answers than No. 3. 

The reason for that could be that the intellectual level of the students in school type 
No. 1 is probably higher than that of the students in No. 3, as mentioned earlier. We can 
test this hypotheses in our next step when we analyze the data we have got on an intelli- 
gence test. 

After all, looking at the ranks of percentages of correct answers our dissappoiniment is 
not so deep as it might have been after the first glance at the data. All in all we are 
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courageous enough to say that the WBT is an instrument which measures the same as 
the TEL does with sufficient accurateness. 

4.2. Communities and Differences between Austrian and U.S. Students 

If we take the results of our data as they are we can at first make a very global statement 
with regard to the American and the Austrian boys and girls in grade 1 1 (cf. Table 9a). 
There is no significant difference between them in the level of perfonnance on TEL or 
WBT, respectively. To put it in other words: Austrian students are not better nor worse 
than their American peers, a finding which is to be taken seriously at least all who 
are engaged in economic «iucation. 

If we look at the results in more detail we remark that the Austrian group with the worst 
value is in the Dual Vocational System. Their mean is about 3 points lower than the 
mean of the American high-school students "without economics". We think that wc will 
have to watch carefully whether this result is stable when the number of persons in- 
cluded is growing. At the mon^nt we have only the data from 64 students from this 
school type. Therefore it is perhaps too early to look at consequences which were to be 
drawn from this. 

On the other side of the scale we find that the Anwrican students with economics are as 
successful on our instrument as the best subgroup of the Austrian students (i.e. No. 2; 
cf. Table 9a). That is very impressive because the Austrian students receive much more 
lessons with economics-related contents than their Atmican peers. Admittedly they 
have a lot to learn in business, management, and law. But wc had expected that they 
should perform significantly better on the WBT than their An^rican equals in age did 
on the TEL. May be, the nmn reason is that they will be tought "pure" economics only 
in grade 13 (cf. Table 4a). After that they will probably perform significantly better than 
their American counterparts. In our first paper we had preliminary findings from three 
classes of grade 1 3. Their mean WBT-score for from A was 25.93 and for form B 
28.80, 

If comparing American students who had a course in Social Studies with the Austrian 
school type No. 1 students one looks at two groups who have in common that their first 
or, let's say, vocational interest - also in terms of curricula - is not wronomics nor 
business. Nevertheless they reach comparatively high scores on our instruments. We 
think that one should not exclude that students grasp the ideas of economics, the con- 
cepts of MCG, better if they are taught rather in the context of politics than in the con- 
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text of business and management problems. Perhaps it is moK motivating to think about 
economics problems as problems with soim latitude fOT moulding by politicians - in 
other words: to look a? economics through the eyes of a citizen with his whishes, de- 
mands, and claims. On the other side of this view stands the supposition that in the 
context of vocational training the students can't see where it is possible to influence or 
to use circumstances which we ctescribe with economics concepts. If it is true that it is 
more motivating to think in acts, at least in virtual acts, then it might be plausible that 
students are more successful in thinking of them^lws acting "on economics" as po- 
liticians than as single subjects in frnns, e.g. as managers. 

These considerations would also match on our results for the Austrian Senior 
Vocational Schools. Students attend them not only with the aim to be vocatie.ially 
trained but also to get the allowance to enter university. It is in this case not unlikely 
that they draw their motivation for learning ectmomics from the latter perspective, 
namely thinking as a critical ci izen. 

Going back to our data we found last but not least another similarity between the TEL- 
data and the WBT-data. As you can easily see on Table 9b our girls perform also not as 
well as the boys do on the test. This result is compatible with our everyday experiences 
but is from our point of view not at all acceptable. As Marianne A. Ferbcr (1990) states 
economics is infected with male-specific concepts, pictures, and examples. And it 
should be possible to change things towards more gender balance. The same may be 
true for an access to economics from the side of social snidies. At least in Europe we are 
used to lalk about politics in terms of acting men rather than women. And most young 
girls cannot imagine to be themselves the acting subject in politics. 

On the other hand looking at the U.S. data it seems that the differences ,^^ilbin the 
gender groups are larger than isia^. Therefore whether one explores or neglects the 
!5ender differences our common main problem is to raise the level of economic literacy. 
We are not very hopefully with regard to a quick reaching of this aim. Yet we are not 
only hopefully but sure that we can present soon more and more detailed data and infor- 
mation on the empirical facts concerning the state of economic literacy in our countries. 
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Table lb: 

School Structure: Germany 
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dary 



Pri- 
mary 



Years 
of 

Scbool 



19 



18 



17 



16 



15 



14 



13 



12 



10 



9 



8 



6 



University 



(1) 



Further Education 



General Secon- 
dary School 
(Lower and 
Upper Cycle) 



(2) 



Senior 

Vocal. 

School 

(Upper 

Cyc.) 



Academy 



Special 

l^ocat. 

School 



(4) 



Secondary 
School 

(Middle Cycle) 



(3) 



Intermediate 
Vocal. School 
(Full-Time) 



GeacfAl and 
Special Voc. 
School (Pari 
Time eod 
Eveninc) 



Voc. Adult 
EducaUon 
(in nrni 
Traioiog) 



InUnnediBie Vocal. Activity 



5 (a.b) 



Dual Voc^L System: 
Part-^Time Vocal. 
School/Apprenticeship 
(Different Branches) 



Lower Secondary School 



Primary School (Lower Cycle) 



Ele- 
men- 
tary 



Preschool/Nursery 



ERIC 



IP 



Table Ic: 

Schocl Structure: USA 



Further Education 



Age 
24 



23 



22 



21 



20 



19 



18 



Edu- 
cation 
Sectm- 



Yean 
of 

Sctiool. 



Highei 
Edu- 
cation 



19 



18 



17 



16 



15 



14 



13 



University 



Undergraduate: 
Liberal Arts or General 



Juaior or 

Community 

Colleges 



Technical 
Institutes 



Professional 
Schools: 

(Teaching. 
Medicine, 
; Theology. 



Undergraduate: 
Liberal Arts or General 



Lfaw etc.) 



17 



12 



16 



15 



Secon 

dary 

Edu- 



11 



Senior High Schools 



10 



4-year High Schools 



14 



cation 



9 



13 



8 



Junior High Schools 



12 



Combined 
Junior - Senior 
High Schools 



11 



8 



10 



8 



Ele- 
men- 
tary 
or 

Pri- 
mary 
Edu- 
cation 



Elementary (or Primary) Schools 



K 



Kindergartens 



NS 



Nursery Schools 



4 



Table 2; School Types: She .t Descriptions (Austria and Germany) 
The WBT was administered in the following schools: 



Short 

No. Name Designation 
1 GGS General Secondary School 



2 SVS Senior Vocational School 



3 IVS Intermediate Vocational School 



4 SSG Secondary School {Germany only) 



5 DVS Dual Vocational System 



5a DVS/R -/Retail (commercial depts.) 
5b DVS/I -/Industry (commercial depts.) 



Description 

Schools of general education (not vocational) which 
provide the possibility of attending university. 

Schools of general and vocational education permitting 
entrance to university as well as to business (with a 
degree) . The vocational qualification is in Austria 
higher than in Germany. 

School of vocational education providing a middling 
training for a career in business (no entrance to 
university) . 

School of general education (not vocational) providing a 
middling degree for entrance to secondary higher educa- 
tion institutions. 

School of vocational education for apprentices offering 
a one-or-two-days trainig per week ("theoretical back- 
ground" for the "practical" work in the firm for the 
rest of the week) . 

Different branches (agricultural, house keeping, 
crafts, commercial) 



1 



n 



ERIC 



Table 3; Percentages of an Age-Group Attending the Different 
School Types 



Austria 


School Type 
1 

Gen.Sec.Sch. 

15,2 


2 

Sec.Voc.Sch. 
3,8 


3 

Int.Voc.sch. 

5,8 


Dual V0£ 
49, 4 


thereunder 
commercial 

23,7 


others 
25,8 


Germany 


27,3 


2,0 


10,3 


30,7 


thereunder 
commercial 

10,3 


29,7 



o ( ) pi 

ERIC 



1 



0 



Table 4a; Economic Knowledge related subjects with hours of instruction per week: AUSTRIA 



Sub j ect 



Grades 



Type of School 
1 

Gen . Voc . 
Sch. 

9 10 11 12 



Sen. Voc. Sch. 
9 10 11 12 13 



Int. Voc. 
Sch. 
9 10 11 



5a 

Dual Voc 
Syst/Ret 
10 11 12 



5b 

Dual Voc 
Syst/Ind 
10 11 12 



1. History & Social Studies 

2. History & Social Studies 
{Economic History) 

3. Geography & Economic s 

4. Geography & Economics 
(Economic Geography) 

5. Accounting & Economics + 
Mathematics 

6. Business & Management 

7. Special Business & 
Management (e. g. 
retail, industry) 

8 . Economics 



4+2 



4+2 



Sum per grade 



12 



10 



14 



13 



10 



Sum total 



Rank 



16 



5. 



56 



1. 



25 



2 . 



17 



4. 



20 



3. 



23 



ERIC 



22 



Table 4b; Economic Knowledge related subjects with hours of instruction per week: GERMANY 



Subject Grades 


Gei 
8 


1 

i.Vt 
Scl 
9 


of 

>c, 
1. 
10 


4 


5chc 
S( 
8 


>ol 
m. 
9 


• 

Voc 
10 


> 

11 


5ch. 
12 


13 




Int. 
S( 

9 


3 

, Vc 
:h. 
10 


>c. 
11 




i 

St 
Sch, 
9 


I 

SC. 

.(9) 
10 




DU( 
Syi 
10 


5a 
il T 
5t/l 

11 


^oc 
let 
12 




DUi 

Sys 

10 


5b 

a T 

3t/] 

11 


[nd 
12 




1. Social Studies 

2. Book keeping 

3. Economic Maths 

4 . Accounting 
(partly with EDP) 

5. Business. Economics, 
and Law 

6. Business & Management 

7. Special Business & 
Management (e. g. retail, 
industry, organization) 

o . £iConoiuics 


1 


1 


1 




1 


2 
4 


2 
4 


3 
3 


6 


6 




2 
4 

3 


1 

3 
+ 1 

3 

2 


3 
+2 

3 
1 

2 




2 


1 




2 
2 
1 

4 


2 

2 
2 


1 

2 
2 




1 

2 
1 

3 


1 

3 
2 


1 

3 
1 




Sum per grade 


1 


1 


1 




1 


6 


6 


6 


6 


6 




9 


10 


11 




2 


1 




9 


6 


5 




7 


6 


5 




Sum total 


3 




31 




30 




3 




20 




18 




Rank 


5./6. 




1. 




2. 




5./6. 




3. 




4. 





2 



ERIC 



25 



Table 5; Analyis of Syllabus Plans of the Different School Types on the Basis of the 
22 TEL/MCG-Concepts 



Country 




A u 


s t 


r i 


a 








Germany 




School Type 


0 


1 


2 


3 


1 


> 




1 


2 


3 


4 


5 


TEL/MCG-Concept 


HS 


GSS 


SVS 


IVS 


DVS/R 


DVS/I 




GSS 


SVS 


TVS 


SSG 

•ta? w7 w 




DVS/T 


1 Scarcity 


(X) 


X 


(X) 


(X) 


(X) 


(X) 




X 


y 




Y 
A 




^ Y^ 


2 0pp. cost/ trade offs 




























3 Productivity 

■4 


X 


X 


(X) 


(X) 


X 


X 




X 


(X) 




(X) 






4 Economic systems 


X 


X 


X 


X 










X 


X 


X 


X 


y 


5 Ec. mst. & incentives 


X 


X 


X 


X 










V 

sx 






X 

mm 


X 

*> 


6 Exchange, money, interdep. 


X 


(X) 


X 


(X) 








X 


Y 


X 




X 


7 Markets & prices 


X 


X 


X 


X 


X 


X 




X 


X 


X 


X 




X 


8 Supply & demand 


(X) 


(X) 


X 


(X) 




(X) 




X 


Y 


X 


X 


X 


X 


9 Compet. & market struct. 


X 


X 


(X) 


(X) 


X 


X 






X 


X 


X 


X 


X 


10 Income distribution 


(X) 


(X) 


X 


X 








X 


X 




X 


X 


X 


11 Market failures 






X 












X 










12 Role of Government 


(X) 


(X) 


X 


(X) 








X 


X 


X 


X 


X 


X 


13 Gross national prod. 


X 


(X) 


X 


X 










X 


X 


X 






14 Aggregate supply 






(X) 


(X) 










X 






X 


X 


15 Aggregate demand 






(X) 


(X) 










X 




X 


X 


X 


16 Unemployment 


X 


(X) 


{X) 


(X) 










X 


(X) 








17 Inflation & deflation 


X 


(X) 


X 


X 










(X) 


X 


X 






18 Monetary policy 


(X) 


(X) 


X 


(X) 










X 


X 




X 


X 


19 Fiscal policy 


(X) 


X 


X 


(X) 










X 




X 






20 Comp. advant./ trade barr. 


(X) 


X 


(X) 












X 










21 Bal. of payment/exch . rates 


(X) 


X 


X 


(X) 




(X) 






X 


X 


X 






22 Int. groth & stability 


(X) 


X 


X 


X 










X 










Number of Matches with TEL/MCG 


(18) 


18 


21 


19 


4 


6 




7 


21 


11 


14 


11 


12 


■ ■ 

Rank (expected in WET performance) 


not 


3 . 


1. 


2. 


5. 


4. 




6. 


1. 


4./ 


2. 


A./5. 


3. 




af pi 


















5. 









Of- 



Table 6: 



Ratings of Austrian Teachers 


on WBT 


Items (N;^~37, 


%-25) 






Form A 






Item 


1 iC OLA i 








1 




s 


2.7 


1 . 1 


2 


3 5 


1 4 


3 . 6 


1 . 3 


3 


1 8 


1 0 


2.1 


1 . 1 


4 


2 1 


1 0 

X ♦ V 


2.4 


. 8 


5 




X • -J 


3.1 


1 . 1 


6 


1 ft 


Q 


1 . 9 


1 1 


7 


1 4 


• u 


1 6 


8 


8 




Q 
• -/ 


2.2 


1 0 

X • w 


9 




£: 


1 7 


8 


10 




1 1 
1 • X 


2 1 


7 


11 




Q 
• 17 


2 1 

^ • X 


7 


12 




Q 
• .7 


2.2 


8 


13 


J. • ij 


7 


1 5 


6 


14 






2.0 


. 9 


15 


€m • Cm 


1 4 

X • M 


2 . 3 


1 3 


16 


7 0 




1 6 


1 0 


17 


7 7 




2 4 


1 . 2 


18 


1 ft 


1 n 


2 . 0 


1 0 


19 






2 . 0 


9 


20 


7 4 




2 . 2 


1 . 1 


21 


1 ft 




1 8 


. 7 


22 




1 ? 


1 9 


1 0 


23 




1 1 

X m X 


2 7 


1 3 

X • 


24 


7 1 

^ • X 


Q 


2 0 


1 2 


25 


X • X 


7 1 


2 1 


1 2 

X • ^ 


26 


1 7 


1 0 

X m 


1 6 




27 


2 0 


8 


2.2 


1 . 0 


28 


2 1 


1 1 

X • X 


2 3 


. 8 


29 


2 . 5 


1 2 


2.7 


1 . 2 


30 


1 . 7 


1 . 3 


1 . 8 


. 9 


31 


1 . 8 


1 . 0 


1 .8 


1 . 1 


32 


1 . 8 


. 9 


1 .8 


1 . 0 


33 


2 . 1 


. 9 


1 .5 


. 7 


34 


1 8 


9 


1 .8 


. 7 


35 


2 2 


1 1 

X • X 


2.2 


. 9 


36 


1 8 


1 1 

X # X 


2.1 


. 8 


37 


1 9 


1 0 


1 . 9 


. 8 


38 


2.0 


1.0 


2.2 


1 0 


39 


2.1 


1.1 


2.3 


. 8 


40 


2.5 


1 .2 


3.3 


1 . 4 


41 


2.1 


1.0 


2.3 


.8 


42 


1.7 


.8 


2.2 


. 8 


43 


2.1 


1.0 


2.1 


.8 


44 


2.3 


1 . 1 


1.9 


1.3 


45 


1.6 


.9 


1.7 


.6 


46 


1.9 


.8 


2.1 


.8 


Average: 


2.0 


.4 


2.1 


.5 



Note: (1 = very good/ 5 = very bad, 3 = 'mean') 
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Table 7 ; 

Comparative Aggregate Statistics for TEL and WBT (Austria only) 

A B 



TEL WBT TEL WBT 



Number of Students 4235 356 3970 338 

Cronbach's Alpha .87 .75 .88 .79 

Mean 22.06 21.45 22.13 23.14 

Std. Dev. of Mean 8.33 6.10 8.68 6.63 

Std. Error of Measurement 3.06 3.05 3.04 3.03 

Average Item-Total- 
Correlation .32 .21 .34 .24 




Table 8a: 



Percentages of Correct Responses and Discrimination Power of WBT 
Form JV 



Item 


Corrected 




Percent 


Correct 






Item-Total- 


1 




"J 


D 




Correlation 


GSS 


svs 


IVS 


DVS 




(N=356) 


(N=80) 


\N"12o) 


/XT 1 1 A \ 

(N=l 14 ) 


/ M --^ o yi " 

(N=34 


1 


. 1 o 


D / • 0 


cn 0 
o / . z 


7 




2 


• 24 


O Q O 

ZD . 0 


A A 

43.0 


A O 

. z 


Z O • 0 


3 


• 07 


o o 
O . O 


y . 4 


on o 
zU . z 


1 1 . o 


4 


. 15 


3U . 0 


zy . / 


9 7 O 
Z / . Z 




5 


.22 


O C. A 

2b . 0 


O Q A 

zo . y 


O 1 Q 

z i . y 


1 yi T 


0 


• Z 1 


4z « O 


f^7 O 
D / . Z 




9 fi R 
Z O • Q 


7 


.18 


AC A 

95 . 0 


OO . 3 


Q R 1 


/3 . ;> 


8 


.15 


72 . 5 


/3 . 4 


TO Q 

/z • o 


5o . o 


9 


.23 


65 . 3 


94.5 


Q Q ^ 
OO • O 


yi 1 o 
4 1 . Z 


10 


.26 


51 . 3 


41.4 


O A 

36.0 


1/1 T 

14.7 


11 


o o 

.28 


/ 3 . 0 


DO Q 
OZ • O 


^9 "7 
OZ . J 


n n 
DU . u 


12 


.17 


61 . 3 


66 * 4 


A O 

62 . 3 


58.8 


13 


.26 


58 . 8 


/To A 

68 . 0 


56.1 


47 . 1 


14 


. 1 8 


O d A 

35 . 0 


A A a 

44.5 


^1 o 

41.2 


3d . 3 


15 


. 1 9 


IT *5 A 

53 . 8 


40 . 6 


yi O T 
4z . 1 


OA 

Z U . D 


16 


. 2 y 


51.3 


7 


ft 

^ o . o 


9 A 
*5Z . 


17 


. 12 


3 / . 5 


4 D • y 


^ n A 


0 a ^ 
Z 0 • D 


18 


.36 


81.3 


OA Q 

89.0 


1 A ^ 


1 ft 
D X • 0 


19 


. 34 


61 . 3 


TO T 
/Z . / 


Oi • 4 


yl 1 9 
ft X « Z 


20 


. 34 


>l C A 

45.0 


^ o o 
4Z . Z 


9 ^ ^ 


17 

X / . 0 


Z 1 


. Z 1 




RO /I 


4ft 9 
'i O • Z 


00 t: 
z ^ . 


22 


. 1 0 


Id A 

15.0 


o yi O 
Z4 . Z 


1 7 
ID./ 


on 

z u . 0 


23 


.24 


31.3 


O Q O 

3o . 3 


1 tf^ 7 
ID-/ 


on 

z u . 0 


24 


. 15 


5 / . 5 


^T O 

o / . z 


R ft 
OD . O 


R 9 Q 
DZ * )? 


25 


. 04 


1 . 3 




7 Q 


17 

X / • 0 


o c 
Zo 


. 3Z 


0 1 . J 


^4 ft 


•4 V/ . *3 


9 Q A 


27 


. Zh 


41.3 


AO O 
^Z • Z 


ft J . y 




o o 


. 1 U 


fi D . O 




«> 0 • u 


Of, ^ 
Z 0 . %y 


o ft 

z9 


'J /i 
. 34 


7 1 ^ 
/ 1 • J> 


OZ . 0 


m ft 
^ X . o 


9 a; r 
z 0 . 0 


30 




c c: A 


^7 9 
O / . Z 




9 fi ^ 

Z D • 3 


J i 


• ^ ^ 








23 5 


JZ 


. 03 


ft 


^ ft yl 




c;ft ft 
30 . 0 


33 


. 04 


Z c5 . o 


O O 7 
zz • / 


OA fk 
Z *i • O 


oc 0 


34 


1 A 

. i 4 




m H 


"^n 7 


OCi ^ 
ZU . D 


3i> 


. U 3 


z / • D 




O . J> 


Rn n 




. J u 


ft ft 


OH • H 


7S 4 


18 2 


J / 


9 7 


fin n 


vz . ^ 


47 4 


IS 3 


38 


.07 


41.3 


36.7 


32.5 


32.4 


39 


.23 


40.0 


53.1 


41.2 


26.5 


40 


.28 


47.5 


. 46.9 


48.2 


20.6 


41 


.26 


36.3 


41.4 


33.3 


17.6 


42 


.32 


58.8 


63.3 


58.8 


26.5 


43 


.16 


30.0 


23.4 


21.9 


29.4 


44 


.26 


52.5 


53.9 


50.0 


35.3 


45 


.36 


58.8 


60.9 


52. 6 


41.2 


46 


.30 


41.3 


33.6 


31.6 


23.5 



Table 8b: 



Percentages of Correct Responses and Discrimination Power of WBT 
Fozm B 



Item 


Corrected 




Percent. 


Correct 






1 uSiB"" 1 ocai 


1 


9 




D 




Cc rrelat ion 


GSS 


SVS 


IVb 


UVo 




(N=338 ) 


(N=72) 


{N=l 31 ) 


/ XT 1 A C \ 


/XI "3 A \ 


1 


• 10 




Jl> • 1 




Z 0 . / 


2 


. 20 


35 • 1 


4 / . 3 


34 . 3 


00./ 


3 


. 09 


15 • 3 


O ^ T 

26,7 


0 1 n 
21.0 


0 . / 


jk 
4 


. 25 


65 • 7 


77.1 


0 J • 0 


AC n 

HO 0 f 


5 


. 18 


23 . o 


2 U . 0 


0 £r n 
2b./ 


9 A A 

2 U . U 


O 


. 35 


"2 1 Q 


. r 


An a 


9 0 n 
z u . u 


7 


. 15 


85 • 1 


84 . U 


01 A 

0 1 • y 


00./ 


8 


• 30 


50 . 0 


OA 0 

0 U . 2 


9 Q 
0 J • 0 


9 9 


9 


• 26 


52 • 8 


94 . 7 


00 A 

o2 . 9 


9 9 
b J . J 


10 


.10 


72 . 2 


/2 . 5 


/5 . 2 


bo . / 


11 


. 33 




on 0 


^9 Q 

dz • y 


^0 • / 


12 


. 05 


34 . 7 


A A 'O 

44.3 


45 . 7 


A A 
40.0 


13 


. 20 


/"A A 

69.4 


74.8 


<C 0 A 

62 • 9 


^0 0 

63 , 3 


14 


. 33 


C A A 

50 . 0 


61.1 


OA A 

39 • 0 


3b . 7 


15 


• 30 


84 • 7 


80.9 


7o . 1 


CO 0 

53.3 


1 6 


. 31 


oy • / 


/ / , y 


DO . / 


^ 9 9 

D J . J 


17 


. 19 


OA o 

29.2 


45.0 


CO A 
52 . H 


yi A A 


18 


O IT 

.25 


75 • u 


Q T 0 


no 1 
/o . 1 


"9 A A 
/ U • U 


19 


. 37 


Co d 

52 • 5 


oy . D 


Q 1 
00 . 1 


09 9 

2 J . J 


20 


. 25 


0 / # 5 


4 1.2 


/I 9 Q 
4 J - 0 


OA n 




. 2y 


OO • O 


0 C, m f 


Z) u • ^ 


n n 


22 


• 32 


c A n 
5U . U 


n r\ 0 
/ u • Z 


Do • Z 


Ad 7 


2 J 


. 25 


^5 • o 


/ . J> 


9 4 9 


9 n n 


24 


. 2d 


•31 • y 


DD • f 


9 4 P 


9 0 n 


25 




1 O • 1 




1 T 1 


0 c n 


o 






D f » Jj 


HO m Q 


^ .J • ^ 


27 


. 29 


5y . / 


DA 0 

0 U . 2 


Dz: • y 


9 ^ 9 
^0 . / 


28 


• 04 


J J • J 


ZD m ^ 


9 1 A 


9 £1 0 

Z 0 . / 


29 


.Jo 


/o . 4 


'7 1 Q 


^9 Q 

02 • y 


19 9 


30 


. JO 


s5 . o 


Do . 0 


yi A A 

Hi) m\j 


9 9 9 
D J . D 






• J 


7 4 ft 


S7 1 


H 0 m ^ 


32 


. 33 


O C A 

25 • 0 


A Q Q 


9 A c: 


1 A n 


33 


. 31 


Id A 


/ 4 . 0 


TO 1 


99 9 


34 


. 30 


JO • y 


yl 'T 

*i / • 0 


9 Q 

z 0 • 0 


9 0 n 
z u . u 


35 


• 03 




^Z • ± 


91 4 


99 9 


J> 0 


« 


7 


73 3 


60 0 


36 7 


J / 










^ vy • vy 


38 


.18 


16.7 


22.1 


21 .0 


16.7 


39 


.09 


30.6 


35.9 


42 .9 


43.3 


40 


.27 


33.3 


45.0 


26.7 


13.3 


41 


.26 


51 .4 


43.5 


34.3 


16.7 


42 


.40 


38.9 


48.1 


30.5 


26.7 


43 


.22 


29.2 


36.6 


26.7 


30.0 


44 


,iy 


43.1 


65.6 


66.7 


40.0 


45 


.28 


50.0 


54.2 


49.5 


20.0 


46 


.16 


41.7 


54.2 


45.7 


26.7 
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Table 9a; Comparisons of Means Between Students in the U.S. and 
Austria by School or Course Type 

Rank 

No. and Group hours matches emp. 

of Students Mean Std.Dev. N of instr. MCG data 



Fona A 

Austria 



1 


l^on Qor" Cr'hi . 


22 . 14 


5.2 




80 


5 


3 


2 


2 


Sen. Voc. Sch. 


23.65 


5.6 




128 


i. 


1 


X 


3 


Int. Voc. Sch. 


20.40 


6.3 




114 


2 


2 


3 


5 


Dual Voc. Syst. 


15.09 


4.0 




34 


3/4 


4/5 


4/5 




overall 


21.45 


6.1 




356 








U 


-S. (by course type) 


* 














6 


Economics 


23.57 


8.5 


2 


.585 








7 


Consumer Ec. 


21.70 


8.0 




309 








8 


Soc. Studies 


22.85 


8.7 




259 










overall 


23.33 


8.4 


3 


.153 









Fom B 

Austria 



1 


Gen. Sec. Sch. 


21.71 


6.6 




72 


5 


3 


3 


2 


Sen. Voc. Sch. 


26.26 


6.5 




131 


1 


1 


1 


3 


Int. Voc. Sch. 


22.35 


5.2 




105 


2 


2 


2 


5 


Dual Voc. Syst. 


15.80 


3.8 




30 


3/4 


4/5 


4/5 




overall 


23.14 


6.6 




338 








U 


.S. (by course type) 


* 














6 


Economics 


25.55 


8.9 


1 


.930 








7 


Consumer Ec. 


18.07 


7.0 




405 








8 


Soc. Studies 


22.14 


7.6 




430 










overall 


23.92 


8.9 


2 


.765 









* Taken from Soper/Walstad 1987, 20-21 



Table 9b; Comparisons of Means Between Students :.n the U.S. and 
Austria by Gender 



WBT 

Males 
Females 

TEL* 

Males (with E.) 
Males (without) 

Females (with E.) 
Females (without) 



Form A 
N Mean Std.Dev. 

120 23.54 5.45 
212 20.20 6.20 



Form B 
N Mean Std.Dev. 

120 25.40 5.60 
197 21.74 6.89 



1.516 23.97 8.83 

453 18.84 7.19 

1.412 22.68 7.95 

475 18.12 6.14 



1.371 24.78 9.33 

579 18.33 7.19 

1.376 23.11 8.26 

614 17.78 6.07 



* Taken from Soper/Walstad 1987, 20-21 
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1. Introduction 



"In 1988, it was reported in the United States that thoe was a problem with economic 
literacy of the American high school Students (Walstad and Soper, 1988). We do not 
know if the san» is true for die Gennan-spealdng countries. The reascHi is not that high 
school students in these countries possess a high standard of economic literacy, but 
rather that the state of economic knowledge anxmg students has never been assessed. 
To conect this situation, we decided to translate the Test of Economic Literacy (TEL) 
(Soper and Walstad, 1987) and to administer this German version to students in our 
countries." 

With these words we began our first paper presentation on this problem at the AERA 
meeting 1989 in San Francisco. In the "first phase" we wanted to examine whether the 
TEL is suitable as a test for assessing the econcmiic literacy of German-speaking 
students. In short we firstly repotted the translation problems, secondly the results of a 
questioning of German, Austrian and Swiss University professors as to the content vali- 
dity of the Gciman version of the TEL, which we call WBT ("Wirtschaftskundlicher 
Bildung-Tcst") and, thirdly, the outcomes of a first application of the WBT with some 
750 students. 

Here it is enough to say that the results of this pilot study motivated us to continue this 
work. On the basis of an itemanalysi« we improved sottKi items with extreme values on 
difficulty or discrimination scores. We are now applying the revised version on larger 
samples of Austrian an German students in different levels and branches of our school 
systems. 

Besides assessing the WBT-score we gather data on altitudes to economics, on intelli- 
gence, and on moral maturity. We think that these concepts are components of "econo- 
mic education" in the wider sense of this notion. 

Today we would like to present and discuss some results of our investigations concer- 
ning the WBT. One of our main interest points is the comparison between the US and 
our countries with regard to the achievement level of the 1 1 * and the 12*^ graders. Un- 
fortunately, to date we have not enough data from the German students because of not 
forseen difficulties with the school boards concerning their readiness to allow the 
collection of data. But today the school doors are open. Yet the time was too short to 
have all data collected and computed for this meeting. We are now able to present the 
results from a sufficiently large sample of Austrian students and we have also the 
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information about their teachers' judgements of the WBT-itcms which is important for 
the evaluation of its a>ntent validity. 

Before showing the results of the different tested groups we have tested it is necessary 
to analyze the conditions fcs* the comparison, i.e. the curricular prerequisites uncfer 
which the data are to inteiprete. Then we want to draw your attention on the opinions of 
the teachers about the WBT. We can learn from that whether the measure one obtains 
from administering the WBT is something which - in the eyes of this important group of 
experts - relies on a relevant basis of content Our last point is the presentation of the re- 
sults Mt got in testing four different groups of Austrian students and tlw comparison 
with their US-American peers whose measures were published by Soper and Walstad in 
1987. 

2. Economir Education in the USA, Germany and Austria 

Comparisons of school achievement always beg to question whether the instrument of 
measurement is equally appropriate for smdents from several (school) cultures. The 
problem of comparing student samples and therefore of 'test fairness' must be discussed 
on the outset. Only when this is explained the comparative data can be meaningfully 
interpreted. 

2. 1 . School systemrelated differences 

A comparative analysis of the central features of Economic Education provide a first 
answer as to the fairness of the test. We have attempted this on two levels so far: 

1 . Comparison of the school systems 

2. Comparison of the curricula. 

Let us Stan with the school systems. We have tried to depict the most imponant featurej. 
of the three school systems for a comparison. Tables la, b, and c show the different 
structures. 

For those who arc famihar with the American system it is sufficient to remark only one 
point of Table la for the comparison: Students in classes 1 1 and 12 attend without 
major exceptions fine school type, the Senior High School. Withm this school the 
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students have usually the choice between many optional subjects, one of which is 
economics. 

The German and Austrian school system is considerably different in this respect. 
Students in grades 11 and 12/13 attend many types of schools in Austria and Germany. 
Only the Elementary Schools (grades 1-4) arc comprehensive schools in both countries. 

German and Austrian students at the age of 10 and then again at the age of 14 (Austria) 
or 15 (Germany) have to choose which of the school types listed on Table 2 they want 
to attend. They are not allowed to 6sc\6c whether or not they will be tought a lot of 
economics at these schools. The course-content is mandatory (with only very few 
exceptions). 

These differences in the systems of the USA on the one hand and of Austria and CJer- 
many on the other "diston" the comparison of the Economic Uteracy of the students. 
The American students have the possibility of choosing 'economics' among many other 
courses at their comprehensive school. TTie German and Austrian students must choose 
between types of schools and this decision is probably in no way influenced by their 
interest in economics. Tliey are looking at the legitimations they can get at any school 
and at the role it can play in career planning but they normally don't look at the content 
and the objectives of the curricula. 

For the comparison with US-data we have drawn the major part of our sample from the 
group of the 17 years old students who were in the last but one or in the last year of 
their school. (The only major exception is school type No. 4 (Gemiany); the reasons for 
the inclusion of that group arc not to discuss here for we'll not present data for it.) 

It may be of interest to know the approximate percentage of an age-group attending the 
different schooltypes. The figures we show on Table 3 are somewhat rough estimators - 
it is very difficult to get validc informations - but they show the quantitative importance 
especially for the vocational schools. 

This may be enough for a first glance at the institutional conditions under which the 
comparison has to be done. It is hard to say which of the AustrianAjennan groups is the 
most similar to the American high school students. May be this is mostly true of our 
No. 1 - students (at least looking at the formal structure of the education; cf Table 3) 
but one must have in mind that our No. 1 - students arc, so to say, of the best quality, 
ihe brightest ones. With respect to the general level of intellectual competencies the 
students in the school types No. 3 and 5 would - roughly spoken - be more similar to 



37 



American highschool students. But the diffierence is that they have already made a 
complete decision of vocational specialization. We will reach a better answer to this 
question when we look at the time tables and the curricula of our young poeple. 

2.2. Time Budget-related differences 

In American schools where students usually choose economics in the U* or 12* 
classes it cannot be easily grasped which additional econcmiic knowledge related sub- 
jects they have chosen. You do only know the core of subjects. As far as we know it 
may occur that students with or without an economics course can also choose a course 
in consumer economics. But there are other possibilities for learning economic con- 
cepts, e.g. in social studies courses like govemment/worid studies or geography, and so 
on. 

This is nearly the same in Austria. But there are also major differences as one can sec 
looking at Table 4a. It provides information about the number of hours per week for 
subjects with more or less but mostly less relationships to economics according to type 
of school, subject, and grade. Note: We have normally 40 weeks of instruction per year 
and the curricula are always valid for one whole year. Like in the U.S. there are also 
several subjects with affinity to economics, starting from "History and Social Studies" 
(No. 1) through "Accounting and Economic Mathematics" (No. 5) to "Economics" itself 
(No. 7). Similar circumstances are to be found in Germany as one can see on the Table 
4b. 

The major difference between the U.S. and our countries mentioned above is: Whatever 
type of school an Austrian or (jerman student has attended, he/she was confronted with 
economic topics. The major difference between the Austrian and German school type 
is: From the 8^ grade on, teaching in economic-knowledge related subjects differs 
greatly and these differences should appear in the test results. 

•jooking only at the amount of hours per week we wouki expect that students of school 
type No. 2 (Senior Voc. Schools) in both countries perform best on the WBT. In Austria 
students of school type No. 3, 5, and 1 follow on the next ranks. In Germany we should 
find the ranking order put down at the bottom of Table 4b. 



2.3. Curriculum-related differences 



Tables 4a and 4b do not give an answer to the question to what extent Austrian and 
German students aie substantially confronted with ecom»iics and, in particular, with 
the conception of 'econonoics' that fosms the basis of the TEL. The answer to this 
quesdon is to be found in a ccnnparison of the 22 concepts in the MGG with the 
concepts of the syllabus plans of die German and Austrian schools. 

Again we have provkted a table for this comparison. On Table 5 we have listed the 22 
concepts used for the construction of die TEL/WBT. You find for each school type in 
Austria and in Germany whedier a concept is treated or not Brackets mean that a con- 
cept is not explicitly contained in Uie syllabus but is mentioned indirectly or in 
additional remarks to the syllabus. Lock at die following example: If die aim in die 
German syllabus text runs as follows: "Survey of fusion of firms and competition-policy 
regulations of processes of concentration in a social market economy", we assigned diis 
to concept No. 5 ''Economic Institutions and Incentives" but put it in brackets. 

The analyses for Austria shows (cf. Table 5): 

1 . All Austrian students p*<:eive economic lessons at school which should be just as 
demanding 'ivith regard to the aims as lessons on the basis of MCG. 

2. Until die 8^*^ grade - please look at die column "HS" meaning "lower secondary 
school" - these lessons are nearly identical for all students and comprise in total 
about three hours per week over 3 years in a subject called "Geography & Econo- 
mics". 

3. From the 8^^ school year on all students besides those in vocational schools re- 
ceive economic lessons although in differing class-years with qualitative and 
quantitative differences. All the concepts of economics arc only to be found in 
two subjects, namely "Geography & Econonucs" (No. 3 on Table 4a) and "Econo- 
mics" (No, 8 on Table 4a). All other subjects arc business and business-relaicd 
courses. 

4. Table 5 shows diat, direcdy or indirecdy, roughly the same concepts are to be 
found in the Austrian economics curricula as in the MCXi. 

5. The Austrian syllabus plans do not allow, as in MCG, the setting of the cognitive 
level at which die concepts should be taught. The formulation of the aims, how- 



35) 



ever, shows that, when they leave school, Austrian students should have that 
knowledge, problem awareness, and faculty of judgement that the MCXj demands 
from American high school students 'with economies'. 

6. The German version of the TEL, the WBT, therefore proofs itself as a test which 
is principally appropriate for the aims of Austrian teaching of economics. It is not 
unfair to use it to test Austrian students. 

The analysis of Table 5 for Germany shows quite different facts: 

1. Until the 8^** grade therc is no instruction in economics nor in economics-related 
subjects. 

2. There is only one group, namely school type 2 ("SVS"), who receives lessons on 
economics-related objectives nearly to the same extend as the MCXj would de- 
mand. 

3. There is one agreement between Austria and Germany with regard to the 
curriculum question: The concepts of economics are only presented in two 
subjects, i.c. "Economics" and "Social Studies". 

4. The German (here: the Bavarian) syllabi allow the setting of the aims on a co- 
gnitive taxonomy which is slightly different from that in the MCG. Accounting 
for this differentiation one can calculate a probability score for a correct answer 
on every item in the WBT, We don't show the procedure for that now. The result 
is that the average probabilities per item for Form A are falling from .82 (School 
type 2 "SVS") to .49 (School type 1 "GSS"). 

5. The question whether the WBT is fair or not can only be answered with a hint to 
the norms well have to calculate. They must differ with respect to the different 
curricula. 

If you are now looking at the bottom of Table 5 youll remark in the second line from 
bottom the numbers of occuirences of matchings between the TEL/MCG-concepts and 
the syllabus plans of our different schools. Again, we can rank the school types with re- 
gard to our expectations we should have for the performance on the WBT: The lower 
the number of matchings, i.e. the lower the number of concepts taught within school 
type, the lower the chance of the students to reach high scores. 
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Looking back at Tables 4a and 4b you see that there is some change in the ranks fc»- 
Austria and Germany. We can learn from this that a comparison only based on the time 
spent for economic-related instructions is only one possibility to rank the different 
groups. We v/ill see later on which of our hypotheses on the performance ranks will fit 
with the data. 

3. Teacher's Judgements on the WBT (TEL) 

If our analyses of syllabus plans are valid and if teachers give heed to their syllabus 
plans then we should exp&:t Uie teachers to judge the WBT as a valid instrument Is this 
the case? We asked the teachers of our students to answer the following questions 
(where we omitt^ the teachers of school type No. 1 becau^ we couldn't guarantee that 
they have any knowledge of economics): 

"Please look at the 46 items of the WBT and tell us whether - in your opinion - 
they are raUier good or rather poor indicators for "Economic Literacy". You may 
express your judgen»nt on a scale running from 1 (very good indicators) to S 
(very poor indicators)." 

To examine whether beneath the criterion "Economic Literacy" other concepts with si- 
milarity in meaning fit better on the concept represented by the WBT we presented 
different groups of teachers also the terms "Basic Economic Education" (wirtschafUiche 
Grundbildung), "Basic Economic Knowledge" (wirtschaftliches Grundwissen), and 
"Knowledge about Economy" (Wirtschaftskennmissc). 

Moreover we wanted to know whether teachers from di^eient school types differ in the 
tendency of judgement. Neither school type nor the different concepts produced signifi- 
cant relations within the ratings. Table 6 therefore shows only the overall means for 
each item. 

As one can sec the values are quite good (with an average of 2.0 for form A and 
2.1 for form B) and the standard deviations arc not high. There are only three items 
which fall on the negative side of the scale: No. 2A, a question on opportunity cost - no 
wonder that it appears here for this concept is not treated in Austria as you may 
remember from Table 5; the san» is true for item No. 2B; and the third item is a 
question on the concept of "productivity", namely a question on diminishing returns. 
For the latter we have at the moment no idea why it is rated not so good. (In the WBT it 
is neariy a word by word translation from the TEL.) 
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All in all the teachers judge the it.ms of the WBT as "good" indicates for "Economic 
Literacy". Their ratings are in the average a little better than those of the university pro- 
fessors we asked in our pilot study (form A: mean 3. IS, std. dev. .70; form B: mean 3.3, 
std. dev. .77; cf. Beck/Krumm 1989, 1 1). Supposing that teachers' ratings are moie 
curriculum oriented (or curriculum affected) whereas pn^ssOTS* ratings are more 
related to the '*strocture of the discipline" we can look at both votes as rather strong ar- 
guments for the content validity of the WBT. 

To sum up: The teachers' ratings support the results of our curriculum analyses that it 
makes sense to use the WBT as a measure for Economic Literacy in our countries. Let 
us now look at the results of our Austrism data. 

4. Empirical Results and Comparisons 
4.1. Formal Aspects 

We Stan with a glance at some of the most important statistics. They are summed up in 
Table 7. Though the figures indicate that forai A and form B of the WBT are roughly 
equivalent we have to state that the values for Crombach's alpha, i.e. the internal con- 
sistency, and for the average item-total-correlation, i.e. the average discrimination 
coefficient, are not as good as in the American version. Admittedly, the alpha- 
coefficients seem to be just acceptable but we view the relatively low amount of the 
average discrimination coefficients with concern. 

On Tables 8a and 8b, left side, the single scores for every item are listed. Some arc very 
low and there are only few scores of sufficient amount The correlation between the 
TEL and the WBl discrimination coefficients is only .56 for form A and .38 for form 
B. The reason for this problem may stem from the heterogeneity of the Austrian 
students with regard to the reality of instruction they are confronted with. That is: The 
22 concepts could be treated in the different school types with veiy different weights 
with the consequence that an individual item is not a good predictor for the correctness 
of answers on the other items. 

On the other hand the standard deviations of the n^ans of the WBT arc somewhat lower 
than those of the TEL (cf. Table 7) - a fact which can be seen as an indicator of a 
greater homogeneity of the Austrian sample. The standard errors of measurement of the 
TEL and the WBT are nearly the same. This is because the lower reliability coefficient 



of WBT is compensated by the lower standard deviation. As a last point of this 
comparison look at the means of the TEL and the WBT. The differences between Form 
A and B go in the same direction but, again, the value for the WBT-version is with 1.69 
not as low as it would be desirable. 

Now, looking at the omstnict validity we can ^te thai me means of the different 
groups of students develc^ in the expected direction. On Table 9a you find on the three 
right columns the ranks estimated and the ranks drawn frcHO the data. ¥ar form A tl^re 
is one mutual change between school types No. 1 and 3 where we estimated from the 
analyses of syllabus phms that school type No. 1, the General Secondary School, should 
range after the Intermediate Vocational School on place No. 3. For form B we found a 
perfect match of hypothesis and data. 

Please remember that we pointed out earlier that the MCG-matches should be the better 
IHedictors for the ranks than the hours of instruction. Table 9a shows that this is tnie on 
the basis of our data. But again, k^p in mmd, that making hypotheses on this t^is is 
not yet as precise as one has to wish. It would be better if it were possible to extend the 
concept of match-counting on a second dimension: the cognitive levels of objectives 
and the test-items. It is true that between both lies the reality of teaching and learning. 
We don't know whether the teachers do precisely what the syllabus plans prescribe. But 
the more books and other learmng aids are developed on the basis of syllabus plans the 
closer the connection between aims and item-responses shouki be. We are planning 
therefore an analysis of the nK>st important books, too. 

Coming back to the constmct validity we can look back at Tables 8a and 8b ior a re- 
view of the performance on each item for the four groups of students. We must confess 
that beyond the aggregate data the picture is not as clear as it could be. On form A we 
have only 12 items with the expected rank order and on fomi B even only 10. The major 
exchanges of ranks occur between school types No. 3 and No. 1 where - opposite to the 
hypothesis - No. 1 shows in 26 cases (form A) and in 24 cases (form B) a higher per- 
cental of correct answers than No. 3. 

The reason for that could be that the intellectual level of the students in school type 
No. 1 is probably higher than that of the students in No. 3, as mentioned earlier. We can 
test this hypotheses in our next step when we analyze the data we have got on an intelli- 
gence test. 

After all, looking at the ranks of percentages of correct answers our dissappointment is 
not so deep as it might have been after the first glance at the data. All in all we are 



courageous enough to say that the WBT is an instrument which jjeasures the sanK as 
the TEL does with sufficient accurateness. 

4.2. Communities and Differences between Austrian and U.S. Snidents 

If we take the results of our data as they are we can at first make a very global statement 
with regard to the American and the Austrian boys and girls in grade 1 1 (cf. Table 9a). 
There is no significant difference between them in the level of performance tm TEL or 
WBT, respectively. To put it in other words: Austrian students are not better nor worse 
than their American peers, a finding which is to be taken seriously at least from all who 
are engaged in economic education. 

If we look at the results in mcve detail we remark that the Austrian group with the worst 
value is in uie Dual Vocational System. Their mean is about 3 points lower than the 
mean of the Andean high-school students "without economics". We think that we will 
have to watch carefully whether this result is stable when the number of persons in- 
cluded is growing. At the moment we have only the data from 64 students from this 
school type. Therefore it is perhaps too early to look at consequences which were to be 
drawn from this. 

On the other side of the scale we find that the American students with economics are as 
successful on our instrun^m as the best subgroup of the Austrian studbnts (i.e. No. 2; 
cf. Table 9a). That is very impressive because the Austrian students receive much more 
lessons with economics-related contents than their Andean peers. Admittedly they 
have a lot to learn in business, management, and law. But we had expected that they 
should perform significantly better on the WBT than their Andean ajuals in age did 
on the TEL. May be, the main reason is that they will be tought "pure" economics only 
in grade 13 (cf Table 4a). After that they will probably perform significantly better than 
their American counterparts. In our first paper we had preliminary findings from thresc 
classc:. of grade 13. Their mean WBT-score for from A was 25.93 and for form B 
28.80. 

If comparing American students who had a course in Social Studies with the Austrian 
school type No. 1 students one looks at two groups who have in common that their first 
or, let's say, vocational interest - also in terms of curricula - is not economics nor 
business. Nevertheless they reach comparatively high scores on our instruments. We 
think that one should not exclude that students grasp the ideas of economics, the con- 
cepts of MCG, bpttter if they arc taught rather in the context of politics than in the con- 



text of business and inanageix%nt problems. Pierhi^ it is more OKMivating to think about 
economics problems as problems with soa» latitude for nxnilding by politicians - in 
cHher words: to look at econcHnics through the eyes of a citizen with his whishes. de- 
mands, and claims. On the other side of this view stands the supposition that in the 
context of vocational training the students can't see wteie it is possible to influence or 
to use circumstances which we describe with economics concepts. If it is true that it is 
more motivating to think in acts, at least in virtual acts, then it might be plausible that 
students are marc successful in thinking of themselves acting "on economics" as po- 
liticians than as single subjects in firms, e.g. as managers. 

These ccmsiderations would also match on our results for the Austrian Senior 
Vocational Schools. Snuknts attend them not only with the aim to be vocationally 
trained but also to get the allowance to enter ura^^rsity. It is in this case not unlikely 
that they draw their motivaticMi for learning «:onomics from the latter perspective, 
namely thinking as a critical citizen. 

Going back to our data we found last but nm least another similarity between the TEL- 
data and the WBT-data. As you can easily see cmi Table 9b our girls perftmn also not as 
well as the boys do on the test This result is compatible with our everyday experiences 
but is from our point of view not at all acceptable. As Marianne A. Ferber (1990) states 
economics is inflect^ with male-specific concepts, pictimes, and examples. And it 
should be possible to change things towards more gen^ balance. The same may be 
true for an access to economics from the side of social studies. At least in Europe we are 
used to talk about politics in terms of acting men rather tlian women. And most young 
girls cannot imagine to be themselves the acting subject in politics. 

On the other hand looking at the U.S. data it seems that the differences within the 
gender groups are larger than between . Therefore whether one deplores or neglects the 
gender differences our common main problem is to raise the level of economic lite:.acy. 
We are not very hopefully with regard to a quick re^hing of this aim. Yet we are not 
only hopefully but sure that we can present soon more and more detailed data and infor- 
mation on the empirical facts concerning the state economic literacy in our countries. 
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Table la: 

School Structure: Austria 



Age 



24 



23 



22 



21 



20 



19 



18 



17 



16 



15 



14 



13 



12 



11 



10 



8 



Edu- 
cation 
Sector 



Years 
of 

School. 



Terti- 
ary 



Upper 
Secon 
dary 



■ 11 



Lower 
Secon 
dary 



Pri- 
mary 




19 



18 



17 



16 



15 



14 



13 



12 



10 



8 



University 



(1) 



(2) 



Senior 

Vocat. 

School 

(Upper 

Cyc.) 



Academy 



Special 

\^ocat 

School 



General Secondary School 
(Lower and Upper Cycle) 



(3) 



Intermediate 
Vocal. School 
(FuU-Time) 



Special 

Vocat 

School 



VocaL 
iQsUtuie 



Program. 
Special 
Program. 
Cciirse 



5 (a.b) 



Dual Vocat. System: 
Part-Time Vocat. 
School/Apprenticeship 
{Different Branches) 



Lower Secondary School 



Primary School 



Ele- 
men- 
tary 



Preschool/Nursery 



ERIC 
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School Structure: Germany 



Age 



24 



23 



22 



21 



20 



19 



18 



17 



16 



15 



14 



13 



12 



n 



10 



9 



8 



Edu- 
cation 
Sector 



Terti- 
ary 



Upper 
Secon 
dary 



11 



Lower 
Secon 
dary 



Pri- 
mary 



Yean 
of 

School 



19 



18 



17 



16 



15 



14 



13 



12 



10 



9 



8 




University 



(1) 



General Secon- 
dary School 
(Lower and 
Upper Cycle) 



(2) 



Senior 

Vixat. 

School 

(Upper 

Cyc.) 



Academy 



Special 

^ocal. 

School 



(4) 



Secondary 
School 

(Uiddle Cycle) 



(3) 



Intenned.aie 
Vocal. School 
(Full-Time) 



Ceoerot and 
Special Voc. 
School {Part- 
Time and 



Voc. AduJt 
Education 
(In Firm 
Traimog) 



Intermediate Vocat Activity 



5 (a.b) 



Dual Vocal, System: 
Part-Time Vocat. 
School/Apprenticeship 
(Different Branches) 



Lower Secondary School 



Primary School {Lower Cycle) 



Ele- 
ment- 
tary 



Preschool/Nursery 
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Table Ic: 

School Structure: USA 



ERIC 



Further Education 



Age 
24 



23 



22 



21 



20 



19 



18 



17 



16 



15 



14 



13 



12 



11 



10 



9 



8 



Edu- 
cation 
Sector 



Highei 
Edu- 
cation 



Secon 
dary 
Edu- 
cation 



Ele- 
men- 
tary 
or 
Pri- 
mary 
Edu- 
cation 



Years 
of 

School. 



19 



18 



17 



16 



15 



14 



13 



12 



11 



10 



9 



8 



K 



NS 



University 



Undergraduate: 
Liberal Arts or General 



Junior or 

Conununlty 

CoUeges 



Technical 
Institutes 



4 -year High Schools 



Undergraduate: 
Liberal Arts or General ! 



Professional 
Schools: 

(Tedching, 
Medicine. 
Theology. 
Law etc.) 



Senior High Schools 



Junior High Schools 



Combined 
Junior - Senior 
High Schools 



Elementary {or Primary) Schools 



Kindergartens 



Nursery Schools 



45) 



Table 2i School Types: short Descriptions (Austria and Germany) 
The WBT was administered in the following schools: 



Short 

No. Name Designation 
1 GGS General Secondary School 



2 SVS Senior Vocational School 



3 IVS Intermediate Vocational School 



4 SSG Secondary School (Germany only) 



5 DVS Dual Vocational System 



5a DVS/R -/Retail (commercial depts.) 
5b DVS/I -/industry (commercial depts.) 



Description 

Schools of general education (not vocational) which 
provide the possibility of attending university. 

Schools of general and vocational education permitting 
entrance to university as well as to business (with a 
degree) . The vocational qualification is in Austria 
higher than in Germany. 

School of vocational education providing a middling 
training for a career in business (no entrance to 
university) . 

School of general education (not vocational) providing a 
middling degree for entrance to secondary higher educa- 
tion institutions. 

School of vocational education for apprentices offering 
a one-or-two-days trainig per week ("theoretical back- 
ground" for the "practical" work in the firm for the 
rest of the week) . 

Different branches (agricultural, house keeping, 
crafts, commercial) 



5u 



5! 



Table 3; Percentages of an Age-Group Attending the Different 
School Types 



Austria 


School Type 
1 

Gen.Sec.Sch. 

15,2 


2 

Sec.Voc.Sch. 
3,8 


3 

Int .Voc.Sch. 

5,8 


Dual Voc 
49,4 


:. Syst. 

thereunder 

commercial 

23,7 


others 
25,8 


Germany 


27, 3 


2,0 


10,3 


30,7 


thereunder 
commercial 

10,3 


29,7 
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Table 4a; Economic Knowledge related subjects with hours of instruction per week: AUSTRIA 



Subject 



Grades 



1. History & Social Studies 

2. History & Social Studies 
(Economic History) 

3. Geography & Economics 

4. Geography & Economics 
(Economic Geography) 

5. Accounting & Economics + 
Mathematics 

6. Business & Management 

7. Special Business & 
Management (e. g. 
reta i 1 , industry ) 

6 . Economics 



Sum per grade 



Sum total 



Kank 



Type of School 
1 

Gen. Voc. 

Sch. 
9 10 11 12 



16 



5. 



Sen, Voc. Sch. 
9 10 11 12 13 



4+2 



12 



Int. Voc. 
Sch. 
9 10 11 



10 



14 



13 



56 



4+2 



10 



25 



2 . 



5a 

Dual Voc 
Syst/Ret 
10 11 12 



17 



4. 



5b 

Dual Voc 
Syst/Ind 
10 11 12 



20 



3 . 



Table 4b; Economic Knowledge related subjects with hours of instruction per week: GERMANY 



Subject Grades 


Ti 
Ger 
8 


'pe 
1 

i.Vc 

sc^ 

9 


of 

>c. 
1. 
10 


Schc 
Se 
8 


m. 

9 


2 

Voc 
10 


£ 

11 


;ch. 

12 


13 


Int. 

Sc 

9 


3 

VC 
:h. 
10 


>c. 

11 




Sc 
Sch. 

9 


[ 

ic. 

(9) 
10 




DU2 

sy£ 

10 


5a 
ll \ 
st/I 

11 


foe 
let 
12 




Due 
Sy£ 
10 


5b 
ll \ 
it/1 

11 


roc 

[nd 
12 




1. Social Studies 

2 . Book keeping 

3 . Economic Maths 

4 . Accounting 
(partly with EDP) 

5. Business. Economics, 
and Law 

6. Business & Management 

7 . Special Business & 
Management (e. g. retail, 
industry, organization) 

8 . Economics 


1 


1 


1 


1 


2 
4 


2 
4 


3 
3 


6 


6 


2 
4 

3 


1 

3 
+ 1 

3 
2 


3 
+2 

3 
1 

2 




2 


1 




2 
2 
1 

4 


2 

2 
2 


1 

2 
2 




1 
2 
1 

3 


1 

3 
2 


1 

3 
1 




Sum per grade 


1 


1 


1 


1 


6 


6 


6 


6 


6 


9 


10 


11 




2 


1 




9 


6 


5 




7 


6 


5 


Sum total 


3 


31 


30 




3 




20 




18 




Rank 


5./6. 


1. 


2 . 




5./6. 




3. 




4. 





50 



Table 5; Analyis of Syllabus Plans of the Different School Types on the Basis of the 
22 TEL/MCG-Concepts 



Country 




A u 


s t 


r i 


a 








Germany 




School Type 


0 


1 


2 




5 




1 




J 


4 


5 


TEL/MCG-Concept 


HS 


GSS 


svs 


IVS 








GSS 




TITO 

XVb 


oSG 


DVS/R 


DVS/I 


1 Scarcity 


(X) 


X 


cx> 




(X) 


(X) 




X 

mm 


X 




X 


(X) 


(X) 


2 Opp> cost/trade offs 
























3 Product ivitv 


X 


X 


f x^ 




X 


X 




X 


(X) 




(X) 






4 Economic systems 


X 


X 


X 


X 










X 


X 


X 


X 


X 


5 Ec. inst. & incentives 


X 


X 


X 


X 










V 
A 


(X) 




V 

A 


V 
A 


6 Exchancre . monev . interdeo . 


X 




X 

• • 


(X) 








X 


V 

A 


V 
A 




V 
A 


7 Markets & prices 


X 


X 


X 


X 


V 
A 


A 




X 


V 

A 


V 
A 


V 
A 


(X) 


X 


8 Supply & demand 


(X) 


(X) 


X 


(X) 








X 


V 
A 


X 


V 

A 


V 
A 


Y 
A 


9 CoxtiDet* & market struct. 


X 


X 


f X) 


(X) 


X 


X 






Y 
A 


V 
A 


Y 
A 


X 


X 


10 Income distribution 


(X) 


(X) 


X 


X 








X 


X 




X 


X 


X 


11 Market failures 






X 












X 










12 Role of Government 


(X) 


(X) 


X 


(X) 








X 


Y 
A 


V 
A 


Y 
A 


V 
A 


V 
A 


13 Gross national prod. 


X 


(X) 


X 


X 











X 


X 


X 






14 Aggregate supply 






(X) 


(X) 










X 






X 


X 


15 Aggregate demand 






(X) 


(X) 










X 




X 


X 


X 


16 Unemployment 


X 


(X) 


(X) 


(X) 










X 


(X) 








17 Inflation & deflation 


X 


(X) 


X 


X 










(X) 


V 

A 


Y 

A 






18 Monetary policy 


(X) 


(X) 


X 


(X) 










X 


X 




X 


X 


19 Fiscal policy 


(X) 


X 


X 


(X) 










X 




X 






20 Comp. advant./ trade barr. 


(X) 


X 


(X) 












X 










21 Bal. of payment/exch . rates 


(X) 


X 


X 


(X) 




(X) 






X 


X 


X 






22 Int. groth & stability 


(X) 


X 


X 


X 










X 










Number of Matches with TEL/MCG 


(18) 


18 


21 


19 


4 


6 




7 


21 


11 


14 


11 


12 


Rank (expected in WBT performance) 


not 


3. 


1. 


2. 


5. 


4 . 




6. 


1. 


4./ 


2. 


4./5. 


3. 




appl 



























Table 6: 



Ratings of Austrian Teachers on WBT Items {Na~37, 







Forin A 




B 


I t.Gin 


Me sin 


ouu • Ue V • 


wea.n 


oua • ue V • 


X 


1 Q 


Q 

• 0 


9 7 


1 1 

X • X 






1 A 
X • 1 




X • ^ 




1*0 


X • u 


9 1 

^ • X 


1 1 

X • X 


A 


z « 1 


X • v 


9 A 


Q 
• 0 


c 
D 


0 0 


1 . a 


J • X 


X » X 


b 


1 fl 


Q 


1 Q 


1 1 
X • X 


1 


1 yi 
i . ^ 


• v> 


1 tf^ 
1 • 0 


Q 


0 


z • u 


Q 
• 7 


9 9 
Z • Z 


1 n 
X . u 




i . 0 




1 7 


Q 
. 0 


iU 


Z . 0 


1 1 
1 • 1 


Z » X 


• / 


i 1 


Z • H 


r\ 

0 y 


9 1 
Z • 1 


. / 


1 0 




Q 


9 9 
Z • Z 


Q 
• 0 


i ^ 


1 m D 


7 


X • D 


m 0 


1 A 




Q 
• 0 


9 n 


Q 




Z • Z 


X • 


9 

Z • J 


X • 0 




z • u 


X » u 


X • D 


x • u 


1 "7 


z • / 


X * X 


9 il 


1 9 
X • ^ 


1 Q 
1 0 


i • 0 




9 n 
z • u 


X . u 


1 Q 


9 n 
z . u 


Q 

• 0 


9 n/ 


• y 


0 n 


Z r 


1 n 


9 9 

Z • z 


1 » X 


0 1 


X . 0 


• 0 


1 ft 
X • u 


n 




z . 0 


1 9 
X • z 


1 Q 
X . i? 


X • u 


0 


9 n 
z • u 


1 • X 


9 7 
Z , / 


1 « j> 


0 >! 


9 1 
z . X 


Q 

* y 


9 n 
z • u 


1 9 

X • Z 


ZD 




9 1 
z • 1 


9 1 
Z • X 


1 9 
X . Z 


Z 0 


1 7 


X • U 


X • 0 




Z f 


z • u 


R 


9 9 


1 n 

X » Vy 


^ 0 


^ • X 


X « X 




Q 
• Q 




^ m U 


1 9 

X • 


9 1 


1 9 

X • ^ 




1 7 

X • r 


X V ^ 


T ft 
X • 0 


Q 


^ 1 


X • Q 




1 ft 
X • 0 


1 1 

X • X 




X « 0 


g 


1 8 


1 0 

X p w 




^ • X 


Q 
• 3? 


X • ^ 


7 




1 ft 
X • 0 


Q 


1 ft 

X • 0 


7 


JO 


9 9 


1 1 
X • X 


9 9 


Q 




1 ft 

X • 0 


1 1 

X • X 


9 1 

^ • X 


ft 


J / 


X • !7 


X • u 


1 Q 

X • .7 


Q 
• 0 




9 n 


X • K/ 


9 9 

zi. • /ill 




39 


2.1 


1.1 


2.3 


.8 


40 


2.5 


1.2 


3.3 


1.4 


41 


2 . 1 


1 . 0 


2.3 


. 8 


42 


1.7 


.8 


2.2 


.8 


43 


2.1 


1.0 


2.1 


.8 


44 


2.3 


1.1 


1.9 


1.3 


45 


1.6 


.9 


1.7 


.6 


46 


1.9 


.8 


2.1 


.8 


Average : 


2.0 


.4 


2.1 


.5 



Note: (1 = very good, 5 = very bad, 3 = 'mean') 

erIc fi'' 



Table 7: 



ERIC 



Comparative Aggregate Statistics for TEL and WBT (Austria only) 



B 



TEL WBT TEL WBT 



Number of Students 4235 356 3970 338 

Cronbach's Alpha .87 .75 .88 .79 

Mean 22.06 21.45 22.13 23.14 

Std. Dev. of Mean 8.33 6.10 8.68 6.63 

Std. Error of Measurement 3.06 3.05 3.04 3.03 

Average Item-Total- 
Correlation .32 .21 .34 .24 



I 



Table 8a : 

Percentages of Correct Responses and Discrimination Power of WBT 
Form A 



Item 


Corrected 




Percent 


Correct 






Item-Total- 


1 


z 


3 


5 




Correlation 


GSS 


svs 


IVS 


DVS 




(N=356) 


(N=80) 


(N-128) 


(N=114) 


{N^34 


1 


. 1 D 


D / . D 


CI o 

b / . z 


DO . / 


DO . y 


2 


.24 


2o . 0 


43.0 


O /I A 

34.2 


26.5 


3 


• 07 


8 . 8 


9 . 4 


OA A 

20.2 


11.8 


4 


. 15 


30 . 0 


29 . 7 


AT A 

2 7.2 


C A 

5 . 9 


5 


.22 


25 . 0 


28.9 


AT A 

21.9 


14 . / 


0 


• 27 


4/: . 0 


an o 
b / . /J 


4 0.5 


^0.5 


7 


» 1 8 


95 . 0 


88 . 3 


Ac. 1 

85 . 1 


7 3.5 


8 


IT 

. 15 


72 . 5 


73 . 4 


T A A 

72 . 8 


58 . 8 


9 


.23 


66 . 3 


f\ A C 

94 . 5 


AO ^ 

88 . 6 


il 1 A 

41.2 


10 


.26 


51 . 3 


A '\ A 

41.4 


A A 

36 . 0 


14.7 


11 


.28 


73 . 8 


82 . 8 


^ A A 

62 . 3 


C A A 

50 . 0 


12 


. 17 


61 . 3 


66. 4 


62 . 3 


58 . 8 


13 


.26 


58 . 8 


68 . 0 


56 . 1 


47 . 1 


14 


.18 


35 . 0 


A A C 

44 . 5 


41.2 


35 . 3 


15 


.19 


53 . 8 


40 . 6 


42 . 1 


20 . 5 


16 


.29 


51.3 


VL A 1 

54 . / 


:>o . 0 


. 4 


17 


. 12 


37 . 5 


fi f A 

45.9 


A t\ A 

40.4 


26.5 


18 


.36 


81 . 3 


OA O 

89-8 


74 . 6 


Ol . 8 


19 


. 34 


61 . 3 


72 . 7 


Ol . 4 


>1 1 A 

41.2 


20 


. 34 


45 . 0 


42 . 2 


24 . 0 


17.0 


Z 1 








fi O • ^ 


9 1 ^ 


22 


. 10 


15.0 


24 . 2 


1 o . / 


A A ^ 

20 • 0 


23 


.24 


31.3 


38 . 3 


1 0 . 7 


A A C 

20 . 0 


24 


. 1 5 


57 . 5 


67 . 2 


d5 . o 


51 A Q 

D^: . y 


25 


. 04 


1 . 3 


7 . o 


/ . y 


I / . 0 


O 




D 1 . J 


Of* . o 


>i n A 


9 Q A 


27 


.24 


4 1 . J 




A"^ O 


A Q 

z y . 4 


o o 


• 1 U 


A ^ 


A A ^ 


Jo . u 


/ O . 5 




. J4 


/ 1 . J 


1^0 

Dc. . J 


D 1 • Q 


^ D . 5 


JU 




^^^^ n 


O / . Z 




9^; R 






n 

3 u • u 














flO.fi 




Do . o 


J J 


r\ A 
. U4 




« / 


OA C 




J4 


. 1 4 


41.3 


J4 . 4 


'J n ^7 
JU . / 


on 


Jo 


. U J 




Jo • / 




DU . u 


3 D 


1 n 
. J u 


0 • 0 


Ofi . *i 


7 R Zl 


9 


J / 




ou . u 




^ T yl 
^ / . 4 


9 c; "5 
J5 . J 


38 


.07 


41.3 


36.7 


32.5 


32.4 


39 


.23 


40.0 


53. 1 


41.2 


26.5 


40 


.28 


47 .5 


. 46.9 


48.2 


20.6 


41 


.26 


36.3 


41 . 4 


33.3 


17.6 


42 


.32 


58 .8 


63.3 


58.8 


26.5 


43 


.16 


30.0 


23. 4 


21.9 


29.4 


44 


.26 


52.5 


53.9 


50.0 


35.3 


45 


.36 


58.8 


60.9 


52.6 


41.2 


46 


.30 


41.3 


33.6 


31.6 


23.5 
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Table 8b; 



Percentages of Correct Responses and Discrmination Power of WBT 
Form B 



Item 


Corrected 




Percent 


Correct 






item^'Total-' 


1 
1 


o 


5 


b 




Correlation 


GSS 


svs 


IVS 


DVS 




# %^ *^ o ft \ 
(N=338) 


{N=72) 


(N-l 31 ) 


(N=105) 


(N=30; 




. 1 u 


1 9 • 4 


35 . 1 


Vl A A 

42.9 


A ^ A 

26.7 


2 


. 20 


36. 1 


ill »-» o 
47.3 


A it A 

34 . 3 


36.7 


3 


. 09 


15. 3 


26.7 


21 . 0 


6.7 


M 

4 


. 25 


66 . 7 


77 . 1 


63 . 8 


4 6.7 


5 


. 18 


23.6 


20 . 6 


25.7 


20.0 


6 


. 3d 


31.9 


52 . 5 


4 7.5 


A A A 

20.0 


7 




86.1 


84 . 0 


81 . 9 


86.7 


8 


. 30 


50 . 0 


80 .2 


63 . 8 


63 . 3 


f*V 

9 


• 26 


52 . 8 


94 . 7 


82 . 9 


63 . 3 


10 


. 10 


72 . 2 


T A C 

72 . 5 


75 . 2 


66.7 


11 


. 33 


53 . 9 


OA O 

80 . 2 


^ A A 

52 . 9 


A A 

36.7 


12 


. 05 


34 . 7 


44 . 3 


45 . 7 


40.0 


13 


. 20 


69.4 


74 . 8 


62 . 9 


63 . 3 


14 


• 33 


50 . 0 


51 . 1 


A r\ A 

39 . 0 


36.7 


15 


. 30 


84 . 7 


80 . 9 


78 . 1 


53 . 3 


15 


. 31 


59.7 


77 . 9 


55 . 7 


C A A 

53 . 3 


17 


. 19 


29.2 


45 . 8 


52 . 4 


40 . 0 


18 


• 25 


75 . 0 


87 , 8 


78 . 1 


T A A 

70.0 


19 


. 37 


62 . 5 


^ A C 

59 . 5 


CO 1 

58 . 1 


A A y 

23.3 


20 


. 25 


37 . 5 


41.2 


>l A O 

43.8 


A A A 

20 . 0 




. 2 9 


Z>D . b 


. / 




30 . U 


22 


. 32 


C A A 

50 . 0 


T A A 

70.2 


56 . 2 


/ ^ A 

4 5.7 


23 


. 25 


45.8 


4 / . 3 


34 . 3 


n A A 
^0 . 0 


24 


.25 


31.9 


ot) . 7 


24 . 8 


A A A 

20.0 


o c 
2o 


A O 
. UP 


1 Q 1 
1 0 . 1 


23.2 


T A 1 

17.1 


A iC A 

2 5.7 


2o 


. zo 


A 

DU • U 


D / . ^ 


4 u . D 


A ^ A 

2 3.3 


27 


• 29 


C A T 

59.7 


OA A 

oO . 2 


^ A A 

52 . 9 


36.7 


2o 


. 04 


33.3 


AC A 

25 . 2 


31 . 4 


A A 

25.7 


29 


. 36 


75.4 


71.8 


/* A A 

52 . 9 


1 A A 

13.3 


30 


. 30 


45.8 


CO Q 


40.0 


OA A 

33 . 3 


Jl 


• 2o 


DO . 3 


/ ^ . 0 


D 7 . 1 


>! A A 

4 3.3 


32 


. 33 


AC A 

25 . 0 


il O A 

48.9 


A A C 

30 . 5 


1 A A 

10.0 


33 


. 31 


T C A 

75.0 


74 . o 


A Q 1 

7o . 1 


An A 

33 . 3 


34 


. 30 


O O A 

38.9 


47.3 


A Q a 
2o • 5 


A A A 

20.0 


Jo 


A O 


25.4 


32 . 1 


31.4 


■ST T 


J D 




KOk 7 


/ . O 


fin n 


"7 


J> / 


• JZ 


0 o • J 


Ol t 1 




^ u . u 


38 


.18 


16.7 


22.1 


2i.O 


16.7 


39 


.09 


30.6 


35.9 


42.9 


43.3 


40 


.27 


33.3 


45.0 


26.7 


13.3 


41 


.26 


51 .4 


43.5 


34.3 


16.7 


42 


.40 


38.9 


48.1 


30.5 


26.7 


43 


.22 


29.2 


36.6 


26.7 


30.0 


44 


.19 


43.1 


65.6 


66.7 


40.0 


45 


.28 


50.0 


54.2 


49.5 


20.0 


46 


.16 


41.7 


54.2 


45,7 


26.7 



ERIC 



f;3 



Table 9a; Comparisons of Means Between Students in the U.S. and 
Austria by School or Course Type 



Rank 



No. and Group 
of Students 


Mean 


Std . Dev . 




N 


hours 

of instr. 


matches 
MCG 


emp. 
data 


Fora A 

Austria 


















1 Gen. Sec. 


Sch. 


22 . 14 


5.2 




80 


5 


3 


2 


2 Sen. Voc. 


Sch. 


23.65 


5.6 




128 


1 


1 


1 


3 Int. Voc. 


Sch. 


20.40 


6.3 




114 


2 


2 


3 


5 Dual Voc. 


Syst. 


15.09 


4.0 




34 


3/4 


4/5 


4/5 


overall 




21.45 


6.1 




356 








U.S. (by course type) 


* 














6 Economics 




23 . 57 


8 . 5 


2 


. 585 








7 Consumer ; 


Ec. 


21.70 


8.0 




309 








8 Soc. Studies 


22.85 


8.7 




259 








overall 




23.33 


8.4 


3 


.153 








Form B 

Austria 


















1 Gen. Sec. 


Sch. 


21.71 


6.6 




72 


5 


3 


3 


2 Sen. Voc. 


Sch. 


26. 26 


6.5 




131 


1 


1 


1 


3 Int. Voc. 


Sch. 


22.35 


5.2 




105 


2 


2 


2 


5 Dual Voc. 


Syst. 


15.80 


3.8 




30 


3/4 


4/5 


4/5 


overall 




23.14 


6.6 




338 








U.S. (by course type) 
















6 Economics 




25.55 


8.9 


1 


.930 








7 Consumer 


Ec. 


18.07 


7.0 




405 








8 Soc. Studies 


22.14 


7.6 




430 








overall 




23.92 


8.9 


2 


.765 









* Taken from Soper/Walstad 1987, 20-21 
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Table 9b t Comparisons of Means Between Students in the U.S. and 
Austria by Gender 



WBT 

Hales 
Females 

TEL* 

Hales (with E. } 
Hales (without) 

Females (with E.) 
Females (without) 



Form A 

N Mean Std.Dev. 

120 23.54 5,45 

212 20.20 6.20 



Form B 
N Mean Std.Dev. 

120 25.40 5.60 
197 21.74 6.89 



1.516 23.97 8.83 

453 18.84 7.19 

1.412 22.68 7.95 

475 18.12 6.14 



1.371 24.78 9.33 

579 18.33 7.19 

1.376 23.11 8.26 

614 17.78 6.07 



* Taken from Soper/Walstad 1987, 20-21 



